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0 A method of passing task massages ma data proeastfng system. 



0 Processor s 5^ 7 communicatively attached to a 
Storage subsystem 3 plaoe laslc messages to the 
sutMystam on s queue. The processors do not hawe 
to wait on a queue lock set by another p rocessor or 
subsystem ^MsX dequeidng a message. IWs is 
achieved t»y use of a double ended Cnlead list or 



of messages having an isoiation^fefefence 
point whersin an enquedng end of Oie Ost is loo- , 
kable and accessible independently from the de- 
queuing end of the IsL The locldng primlGve may be 
of the miAi^wooessor lock synchronizing stDmlc 
type such as TEST AND SET. - 
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RoM of th9 fcivOTtton 

This invention relates tD a method and means 
for passing messages between processors having 
order of magnKtide spaed differences to avoid Ihe 
rate of message exctmge being dominated by the 
lower speed. Such message passing occure be- 
tween concurrently executing CPU's and an SKter- 
nal storage sub-system (e^i. synchronous direct 
access storage device (DA80) array). 

BacHground of the Invention 

Contemporary high speed processing or super* 
computing oor^ures up the prospect of 1 000 mflHon 
instnictions per second (MIPS) of coorifinate com- 
puftig across multiple processor s sperfodicany re- 
ferencing sul)stantially slower specialized proces- 
sore such as direct access etDrage device (DASD) 
mty oontrollere. Synch r on izat ion among proces- 
sorasOl requires a oombinatlon of lodes and mes- 
sages. Locks serve to bind resources to taslcs witfie 
messages and their processing operate as syn- 
chronizing evento. In contemporary systems, tasic 
orfenlBd messages ere enqueued' against re- 
sources. Also, the queued access Is governed by a 
C^obal lode Thus, operations are paced by the 
slowest prooessor obtaining toctod access to the 
queue. 

A sin^ central processing unit (CPU) or pro- - 
cesser typically includes a local operating system 
(PSK implementod internal memory, local 
Instruction and«date caches operativety fbrmed 
from the intental memory, an external store, and 
locKi cache, and storage rssouroe managers. How^ 
ever, Mgh speed or superoomputing Involves ap- 
pQcafions exacu^ over several processors. The 
appOcafions initiate tasks to the fomn of OS instnio- 
Hons (REAIVWRTTE). These tasks are queued 
against the resources whfch process toem. In this 
case, these are the general and spectat purpose 
processors of the high speed system. The tasks 
are relatively synchronized (ordered) with respect 
to each other 4tebr posHton plac^nent as mes- 
sages to the queue in a commonly accessible 
porfion of p rocessor shared internal memory. 

The messages (tasks) are expressed as encap- 
sulated operations defined over a range of ad- 
dresses. Where the messages relate to accessing 
external storage, they are enqueued by processors 
in the shared memory and await dequeuing and 
executton by the storage sub-system. ConcunrenHy, 
messages indicative of attered or completed stor- 
age access tasks are also enqueued by the storage 
suthsystem in the shared memory and await de- 
queuing and OMecutton by the processor s . By k)dc- 
ing th queue, the stowest processor such as the 
xtemal store (array controller) can pace the entire 



operattert 

As mentioned above, synchronlzatton Is 
achieved among p rocessor s and tasks using 
queued access messages usually controlled by 
5 some fbrm of tocMng. However, where there is a 
raw disparfty in capadlies, then much may go to 
waste, white the tester proosssor awaite access to a 
queue cunnsntfy bound Oocfced) to a siAstantially 
slower processor. 

f 0 Even where the processor engages external 
DASD storage without delay, there may be a gross 
mismatch of date rates. iUustrBttvely, conounent 
ptocessore SNscuting 100 MIPS and a 100 
MBytes date transfer rate might have to commu- 

16 nicate with a gigabyte DASD having a 1 to3 MByte 
Iransf^ rate and a 10 milfiseoond access t^ 

Patterson et al, 'A Case for Redundant Anays 
of ine)qpenshre Dteks (RAID)", ACM 8IQM0D Con- 
ference. Chkago ilGnols. June 1-3, 1988 discusses 

20 the general sdutton with respect to date rate 
matching to the fomn of accessing N synchronizad 
DASDs to paranet Synchronous behavtor requkes 
N DASDs to rotate at the same rpm, tiava the 
same angular offeot and be accessed In an Men- 

25 tical manner at the same eme. 

As an dtemafive to communtea&ig date in 
psraOel vte Patterson^s eynchronized DASD*s, date 
rate mismateh has been managed by interlocks or 
tockabto buffers. Buffer size and cost have re- 
st) malned as obstactes. .j.vi 

Beausotoa ^ al, USP 3338.582, -intertocked 
CommunlcalkNi System*, issued August 15, 1997, 
v shows an intertock over whldi a tow speed priMos- 
sor paces the transfer from a high speed proce^ 

ss sor. That to, a tow speed processor such as a 
storage control unit (IBM 3880) strobes a 
CPUfehannel (S^) over a demand response in- 
terface todlcattog that R is avaOabto to process the 
next Information unit 

40 Cage, USP 4,454,585. "Buffer For Use With A 
Fbced Disk Controller", issued 8^2^984, dtectoses 
a multi-ported random access memory managed 
by address register manlpcdatton as an asyndvo* 
nous partittoned drcular buifer. Date is read from 

46 or written into consecutive RAM addresses on a 
pailition-at-a-time basis to wrap-around (drcular) 
order. A partttion/bkx:k consiste of a fixed number 
of consecutive RAM addresses sized to hold a 
track sector of data, ttie RAM buffer having a 

60 capacity of at least two such partitions. 

to Cage's buffer, the speed of the movemem of 
fboed btocks of date Is matched between ttie main 
m mory (DMA) of a word processor and an at- 
tached DASD. A DASD write or read command 

65 resulte to date bdng moved eitiier from ttie DMA or 
a DASD track sector into a firet RAM partition. 
Because RAM operations are asynchronous, a de- 
mand transfer from a second RAM partition can be 
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overlapped %dtn ihs first movonriBnt as an atomic 
part of the command (DASO read or witte) being 

Knuth, "The Art of Computer Programming". 
Second Bimon, copyright Addison-Wesley Pub. 
Co. 196a, 1073. VoLl Fundamental Algorithms, 
pages 234^. S31-634. describes a "deque' as a 
Dnear fist in wtMi all Insertions and deletions are 
made at the ends of the list He further defines an 
"Input restricted deque* as a Onear list in wrhich 
Items may be Inserted at one end and removed 
from the other end (8002.2.1 Bflordsel). 

Disclosure of the Invention 

The Invention provides a method of passing 
task messages In a data processing system includ- 
ing a pluralfty of Mgh-speed processors, an exter- 
nal storege subsystem, and shared internal mem- 
ory, said method co mp rising the steps of: defining 
a first Bnload list In the shared Msmai memory wHti 
separately lockable first and second ends: and 
operating ssdd fist as a queue of task messages 
passing between the Hgh-«peed processors and 
the storage subsystem. tocfctfUy enqueuing task 
messages at the first end of fte queue and In- 
dependently kxMbly dequeuing task messages, 
from the second end of ttie queue. 

PrataaUy the method fiather comprises the 
steps of dsRiAig a second Moed list In the shared 
tntemal memoiy with separately lockable first and 
eecond ends; and opening sM second Bst as a 
queue task messages passing between the high- 
speed proosssore and the storage subsystem, with 
task messsoes being kickably enqueued by the 
external storage subsystem at the first end of the 
queue, and Independentfy task messages being 
kKkabty dequeued by the 1^ speed prooesso re 
from the second end of the queue. Correspond- 
b^ly. on file first Bsltask messages are enqueued 
at ssM first end of tte queue by the Mgh-speed 
p roc e ssors, and dequeued from the second end of 
the queue by the SKtemal storage subsystem. 

In a preferred embodiment, reference points 
and operator sets are defined over saki first and 
second fists, one reference point being assodated 
with the second end of each Ust. and each operator 
set including top of fist (TOO) and bottom of list 
(BOQ) pomtsrs. and top of fist (TOQ14 end bottom 
of fist (BOOq tockwofds. Afirst kick Is obtained by 
one of the processors on sakl second end of the 
first fist upon sahf one processor matching th 
BOOL, wtiereupon task messages are embedded 
between ttie retorance point and the last message 
In the 1st. and sM first lock Is released. A second 
kx:k can be obtained ty the subsystem on said 
first end of the first 6st upon sakt subsystem 
matching fiie TOOL, alkming one or more task 



massages to be removed from sakf first fist before 
said second kxk Is released. Only the holder of 
saM second lock (TOOL) may alter any pointer to 
file non-fefsrenoe end of the fist or any of file task 
6 messages in file fist, and only the holder of file first 
lock (BOQI4 may after any pointer designating ttte 
reference point end of the fist 

ft is also preferred that ttie processors originate 
task messages in the form of control btocks 
TO (DCB's) for file subsystem, each DCB specifying 
one or more aooess operafions to be SBcecuted by 
sakI subsystem, sakI OCB^ being enqueued on 
the first Bst by file originating p rocessor s , and sstd 
subsystem dequeuing snd processing each DCB 
rs from sdd first list according to either an external 
discipline OJTO, FILO, FIFO) or aoconfing to a 
priority reordering of sakf first fist or porfion fiiere- 
of. &ch DC8 assumes either a waiting, acfive. or 
completed status. tt>e waiting DCB*s constituting 
20 ttie first fist, active DCB's toeing cunentiy pro- 
cessed, and completad DCB*e constituting fiie sec- 
ond fisL the subsystem then processes task mes- 
sages dequeued from said first Bst updates each 
task message, and enqueues the updated task 
26 messsges onto fiie second Bst s^ originating 
prooessore dsqueubtg and procesdng each u(h 
dated task message from said second fist acoord- 
ing to efiher an external disclpBne (UFO. FILO. 
FIFO) or to a priority reordering of sakJ second ist 
so or portion ttiereof. 

The Invention also provkles a data processing 
system Inchxfing a piurafity of MgMpeed prKes- 
sore, an extsmal storage subsystem, and shared 
Internal memory, saM system further facfaxfing: 
as means for dsfinhg first and second finked fists in 
the shared memory each with separately kMioable 
first and sscond ends; means for operating saM 
fiist and second fists as wait and completion 
queues of task messages respectively, tockably 
40 enqueidng task messages at ttie first end of a 
queue and Independentiy tockably dequeuing task 
messages from the second end of fiie queue: 
means responsive to task messages ori^nating 
from processors for writing ttie task messages into 
46 ttie shared memory, finking said task messages 
Into ttte wait queue, and slgnalOng ttie storage 
subsystem accordingly; means at the storage sul>- 
system aperiodically responsive to said signalUng 
for dequeuing ttie task messages from ttie wait 
60 queue, actively ptocessing ttie dequeued task mes- 
sages, enqu^ilng ttie processe d task messages 
onto ttie completion queue In said shared memory, 
and signalling ttie processors aooordlngty; and 
means apertodlcaHy responsi v e to ttie subsystem 
as signals for daqueulng the p roces s ed task mes- 
sages from the completion queue. 

The above mettiod and means permit proces- 
sors of (Ssparate speed to have overlapped access 
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to either add or remove messages bi queued ac- 
cess QMsWon Older processing) lelafton to each 
other. Thus processors such as a CPU and an 
extenful storaQe 8ut»ystem placing a messa^on 
a queue no longer have to wait on a queue lod( set 

another processor or suttsystem dequeuing a 
message. A double ended anked list or queue of 
messages is used, preferably wHh an 
isolation/Merence point (NULUBLAf^. An en- 
quedng end of the Est (BOQ/BOQg is locfcable 
and aooees ib l e independently from the dequeing 
end or the 1st (rCXyrOQL). Typically the method 
and means ufilize simple meta-piocessor lode 
primitives (In this regard. "meCa-prooessor* de- 
notes available to all processors). The locktog 
primitive may be of the mum-processor lock syrv 
chronizing atomic type such as TEST AMD SET. 
The processor obtains a lock, vvhen available, be- 
fore inserting niessages between the first end and 
the last message on the first queue, and then 
releases the tock. Likewise the 8td)systBm obtains 
a tock. when available, before Insertb^ messages 
between fhe first end and the last message on the 
second queue. The availabiGty of a tock can be 
tested by comparison matching BOQL wfth the 
tesuft from executtog the tock primitive. 

Thus, In other words, task oriented messages 
can be passed between a phirafity of high speed 
processors and a relatively tow^peed eodsmal stor- 
age subsystem commurricatively coupled over a 
shared memory, using oppositely poled queues. 
Rrst and second dense finked Gnear fists are de- 
fined In the shared memory, each fist having in- 
dependently tockabto first and second ends. A first 
tock Is obtained by a processor on the first end of 
the first fist when BvaHabfo, the processor inserting 
messages between the first end and the last mes- 
sage so finked, and releasing sakf first tock. The 
subsystem obtains anottier tock on the steond end 
of the first fist when avaflabto, remov in g messages 
anywhere on the fist and refoasing sakf other lock. 
On the first and second ends of the second Ost the 
roles of the storage sut>-ystem and processor s are 
reversed. 

Brief DescripBon of the Drawings 

Figure 1 shows a CPU/ OASO array data fiow 
emphasizing shared intemal memory, high peribr* 
manoe channel Intwtace (HPCI), array controner, 
and DASD*s. 

f=igures 2A-C respectively deptet a wait queue, 
an active fist and a oompletton queue of DASD 
control btocks (DCB's) selectably tocfcabto at either 
end thereof. 

Figure 3 ifiustrates the enqueue operation on a 
DOB widt and oomptofion queue. 

Figure 4A-B sets forth the dequeue operations 



on a respective first and second exampto of a OCB 
waft and oompletton queue. 

Detaited Description 

The prefened embodiment of this invention 
uses a high speed muRi-pmcessor host interacting 
witti a slower external store. The external stoie Is 
iUustrafively expressed as a synchronous airay of 

10 N DASD^ and an array oontroltor. To enhance 
appreciation of this tbrm of external storage, a t)rief 
description of date organization on the anay 
(striping) and the use of information redundancy 
(parity btocks. ECC) Is pmvtoed. 

YS Patterson'^ type 3 DASD anray synchronously 
reads and writes to N DASOs in cotomn m^or 
order. However. N*1 of the DASO's conttf n data 
and one DASD contains a parity rangtog over the 
ottier data DASDs. That is. one check DASO is 

20 pravkied for the group. The contents of ttie foiled 
DASD can be raoonstnicted In the manner of 
Ouchi. US Pat 4X)92.732. "System for Recovering 
Data Stored to a Fiaitad Memory Unit*, issued May 
30. 187& which disctoses the spreading of data 

26 blocks from ttie same togtoal fito across a string of 
N- 1 DASO's and recording a parity btock on ttie 
m DASD. The parify btock Is an )a)Ring of the 
parity contenta of the N-1 other btocks. Contenta 
from any ^to tnaccess&la DASO can be recov- 

so erad by XOfVng the parity btocks witti the btocks 
stored on the N-2 remaining accessible i>ASO^ A 
similar result can be achtoved if the pari^ btocks 
are not available. 

Typtoally to btock oriented data, a parity suffix 
as or equivaient (Hammtog, CRC) Is appended to 
each data triock. Thus, each parity suffix ctti be 
invoked to detact/torrect intra-btock enor. As de- 
scribed to OucW. when one or more of the btocks 
of «i M-1 sequence are unavaOabto. a parity btock, 
40 whkii a priori spans the N-1 btock sequence, is 
used in cor^junctton witii the remaining btocks to 
rsbuito the unavailabto data btock. Efficient codes 
per se (Hamming, Cycfic Redundancy Check, 
Reed-Sotomon) are elsewhere treated in ttie Dtera- 
49 hire. 

Refentog now to Rgure 1. tiiere is shown a 
system including a an array of processors 1 cou- 
pQng as external storage a synchronous DASD 
array a The processors 5, 7. 9 are of ttie high 

60 perfonmanoe variety such that when operated con- 
cunentiy they have processing speeds to the order 
of 1004* MIPS. A stower special purpose prooeesor 
to the form of DASO army 3 to coupled to army 1 
by way of adapter 15. Ottier Infomiation processing 

ss souroes or sinks such as focal area networica. print- 
ers, or displays wouM Gkewise be coupled over 
counterpart adapters 17. 

The fast and si w processors communicate 
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wtmsnerrayl over a very Ngh speed bus 11 using 
a pomon of sharad bnemal RAM 13 as a^edal- 
taed message lepository. Tto processors c onstitut B 
a (fisfeributed peer cou(^ system with no centrak 
Izod operat in g system or process oontroJ. Afl re- 
sources such as inlemal memory 13. intenrupt fa- 
cility, and glotwl lostisters (not ahomi) are awril^ 
to any processor including the external storage or 
DA8D array subsystem PAS) 3. 

DAS 3 preferably comprtses a RA103 type 
DASO array and an associated enray oontroner as 
deecrfbed for SNBmple In the Psttaroon rabronce 
and In the coi>ending Brady et aL application. EP 
913045035. -METHOD AND MEANS FOR AC- 
CESSINQ DASD ARRAYS WITH TUNED DATA 
TRANSFER RATE AND CONCURRENCY*. 
(AppOcanlfft lef. no. 8AM0429. Even though DAS 
ftpeffltPfi in a peercoupled relationship wHh the 
other processors. It nevertheless queues task oil* 
entad messages against other p rocesso ro or re- 
aouices. Any change In the queue or other acfion 
requests such as halt currant o p eration s are In- 
<ficatad by way or special purpose signala dap 
Signals). 

DAS recehm tasks as messages and commu- 
rteates the results of task process in g via oonbol 
bkxks arranged In the fomi of a decficatad queue. 
Tills queue, as exsrnpBfled In Figure 2i lemains In 
host 1 kitemal memory 13. The system Indudes a 
facinty to reorder fte quaue aoooixSng to diangjbig 
system priorffies. * 

Retentng again to Figure 1. there b shovm an ^ 
array controllor (elements 1941) coupQng the host 
bus 11 by way of iiiannel adapter 15. This path 
praivkfes access to all ^stam resounoes Mudbig 
memory 13. gtobai registers, and tap signals on 
behalf of DAS 3. Adapter 15 preferably attaches 
DAS over a pair of simplex megabyte rate receive 
and transndt Mertaoas 19. 21. The interftees. 
known also as High Performance ParaDeltntBrtaces 
(HIPPI), are desarbed In «ie ANSI Draft Standard 
of 8^989, X3TB«8-127. Revidon BA. This facirt- 
tates recslpt of the socalled tap signals from the 
host and access to the host as Initiated by OAS. 

Host or system funcfions available for DAS use 
Include READA^miTE Internal memory 13. atomto 
TEST AND SET for lock operations In intemal 
memory 13, atomic operations on global registers, 
veoeipt and Interpretation of tap signals from other 
processor s or system elements, and the generaiton 
of tap signals to the system or host 

DAS 3 operates one addressable array of 
DASD's 33.35.37 Synchronized via sync drcuft 39 
to each rotate at the same rpm. have ttie san 
angular offset, and be ac ce ssed In an Identlcfll 
manner at the same time. TWs sokitton maximizes 
data transfer role. This permits high speed sequen- 
tial or skip sequential DASD data transfer. 



Data movement In the Host/DAS dirsctton 
starts from bitomal memory 13 over bus 11 
through adapter 15. rscehrer 19. encfing bi striping 
and parity togic 23. Lo^ 23 Includes the neoes- 
6 sary digital and timing circuits to calcutate a parity 
t>tock by XORIng the N-1 data bk>cks and transfer- 
ring countarpart blocks to ones of the buffer and 
EOC circuits 27. 29. and 31. Each block Is also 
pmtected by appending an EOC byte thsrsto for 
10 error detection and correction on an Intra-block 
tiasls. Access to the N DASD'is Is made synchro- 
nously In the conventional manner. The obverse 
obtains when data movement proceeds in the 
OAS/Host <firection. 
n The task or request Is defined in a control 
block termed a DASD Control Bkx* or DCS. A 
processor at the host bidkis a DAS DCS bi bttennal 
memory 13. It then links the DCS to a WATT queue 
for DAS and signals the enqueuing operation. Sub- 
20 sequently. DAS moves the DCB onto the ACTIVE 
UST. performs DCB requested functions, updates 
the DCB and places It on the COMPLETION 
queue. After detacfing the VO comptetion, the host 
dequeues the updated DCB from the COMPLE- 
26 T10N queue and ascert ai n s 9ie outcome of the 
DCB specified operaSon. 

ReslatBd. a OAS M> request Is respons^e to 
any processa 5-9 fawoldng a READA/mTTE from 
its OS. A DCB Is bdit and plaoed on a WAIT 
so queue tocatsd In Intomal memory 13. A tap signal . 
is ihen sent to DAS. bi tum. the DAS Inspects the 
- queue for tfie next queued DCB using any one of a 
number of work management algorHhms (FIFO. 
FILO. UFO etc). DAS does not need to respond to 
ss' the tap signal as a priority event 

Refening now to Figures 2A-C, the system is 
arranged audi that the DAS "task WATT queues* 
are prkxfty ordersd. A request may be rekx»ted In 
the queue rotative to other tasks or DCB's at any 
40 time prior to to being made active by the DAS. In 
this inventton. such reordering is a special functkm 
of a DEQUE operatkm to be expltf ned 8ut>se- 
quentiy. Noto, that the DCB's remain at the same 
Internal memory 13 real address inespedive of 
49 changes In queue finking priority or acfiveAMaiting 
status. 

One of the attr1t>utes of peer-coupled pmces- 
sors is that the DAS Is respons^e to rsceipt either 
of a tap signal or Its woric management algorithm 

so by finding the next queued DCB via reading an 
anchor pointer in intemal memory 13 established 
during InitiaOzatfon and chan(^ the first waiting 
DCB status from "WAfTIng* to "active. This Is 
aooompOshed by moving the DCB show in Figure 

59 2A to the ACTIVE UST per Figurs 2B. TWs Is 
iMOugtit atxMJt tiy the DAS executing a sequence of 
intemal memory access operations. Once ttie DCB 
Is 'active*, ttte DAS processes the DCB according 
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a ftmdiofi code contained In said DCa Relatadly. 
address Infbmutton In the DC8 dafhw M 
data to be oansteiitfd. In this regaid, the data 
transfer is effectuated by DAS Initiated operations 
througli th9 channel adapter 15. s 

ft should be appreciated that each DC8 can 
assume one of three states, namely, "active", 
•waHIng'. or "completed". 

When a date transfer operation Is c o mp leted, 
the DAS writes completion status in the DCS, to 
changes the OCB state as per F^ure 28 from 
"active" to "Completed", and enqueues the DCS 
n the a ssoc iat ed complet i on queue per Figure 2& 
Also, the DAS may execute a number of DC8 
specHied completion notification pdmifives. Sigr^ is 
cantly, the transfer of date to and from Intsmal 
memory 13 and the DAS te under OAS control. 

Refenfng s60 to Figures 2A<^ there are shown 
several queues off DCB*s. Each queue element, 
generfcally called QQ^ is a contiguous s^ of ao 
words in a memory which both p rocessor classes 
can fetch from and store to In shared memory 13. 
A QEL includes message words as weO as a Gnfc 
pointer word requnred tor queueing. Although each 
QEL could be a different tength, advantageously a 25 
simpto system might use unifbmn sized OELs of. 
perhaps, 32 words each. Typlcaliy. each shared 
memory wofd itself consists of at least enough tA 
posifions to comain the address of any other word. 
For exampfe each word of shared memory could so 
beS4bitelong. 

A poMer to a QEL Is the address off one of the 
words In the QB. (as used in tfds specification and 
Figures 2A-C, the tsnm "pointer" refere ^ther to an 
address, or to a ptee wfiere such an address is ss 
found). Context determines wtMi Is meant The 
word pointed to, the Mc pointer wonJ, nomraRy 
contains «w acUress of another QEU but can corh 
tain a prsdetennined null value such as all tte off, 
or an on. 40 

As illustrated Figures 2AfC, a Blank-QEL is a 
QEL whose link pointer word is nulL Also, a queue 
may be fbnned from either a single Blanlc-OEU or 
a set of QELs finked one to another by pointers 
leacfing from a top QEL to a bottom QEL The latter 46 
is always a Blardc-QEL when the bottom pointer is 
unlocked. 

Qumies are kxked by using a muttlprocessor 
synchrenizing kx:k operation avaiiabte to all parttei- 
pating multiprocessor classes. An exampte is the so 
classto Test and Set operation whteh stores a took 
constant In a word off shared memory. If the pre- 
ceding fetch. whk:h te part of the same atomto 
operatkm, returns a value other than this kick con- 
stant, then the Test and Set operalton has suooese- ss 
fully todoed the took word. 

A queue header consiste of four wonis in the 
shared memory as shown foUowing: 



TOQ Top of Queue Pointer Shared mem- 
ory address of Bnk pointer word of the 
top QEL In the queue. 

BOQ Bottom of Queue F^Uttor. Shared 
memory address of link pointer word 
of the bottom QEL in the queue. 

TOQL TOQ Lock Word. For example a Test 
and Set took word. Only the holder of 
the TOQ kxk may alter the TOQ 
pointer or any of the contente of 
QELe linked abovo the QEL pointed 
to by BOa <Mote that the BOQ point- 
er may change white TOQ is toctod: 
seeBOQL.) 

BOQL BOQ Lock Word. Only the hokfer of 
the BOQ took may after the contente 
of the QEL at the bMom off toe 
queue, possibly making it non-blank. 
Only the BOQL processor/hokler may 
change the BOQ pointsr vdue, and 
then only if the new value is the ad- 
dress of a vaOd Blank-OEL 
Chan^ng tfie BOQ pointer moves toe isolatton 
point between the enqueuing and dequeuing pro- 
cesses. Once the BOQ is changed, the BOQ took 
hoUer^ authority to update Is reduoed to the New- 
Blank-QEL and to the BOQ pointer. A TOQ lock 
hokfer is always free to update any QBs down to, 
but not including, the QEL pointed to by toe BOa 
whetoer the BOQ to tochad ornbt 

Applying the above definittons to F^jures i^ . 
there are shown constnicte indicative of toe thiee// 
states into .whtoh each DOB rnust be resolved (wait, , 
active, comptoted).-.DGB'a classified as waiting or 
compteted are enqueued white .an .active ^PCB is 
being processed, to each cpjeue, each DC8 has a 
pointer to the next DCS in the chain. The BOQ 
pointe to a nuO or blank DCB operathre as the 
queue bottom white TOQ pointe to the most rebsnt 
queue addillon. 

fftefsnffng now to F^ure 3, there is defected an 
enqueue operatton as the feeding of a message 
into toe Blank-OEL at the bottom of a queue, and 
the appending to the bottom off the queue off an 
additfenal QEL as the NewHUank-QEL The en- 
queue operatfen includes the steps of: 

1. tocking BOQ, condiflonally waiting for the 
queue to become avaiiabte; 2. writing a null into 
link pointer of the addittonai QEL, "New-Blank"; 3. 
writing the memory address of New-Blank into 
Linkage Pointer of Okt-Blank; 4. toadtog a message . 
Into the fdnner Btenk-QEL, "OkJ- Blank"; S. putting 
memory address of New-Blank into the BOQ point- 
er word; and 6. untocMng BOa . 

The od^nal queue has not been attersd except 
for the contente off the original Oank^EL. The 
original Blank<2EL was toitially at the bottom of the 
qu ue. Only the processor/hokter of to TOQ took 
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may after the queuo*^ noivblank QEL8. 

The enqueuing processor can add mom than 
one QBl In proii a raO o n for enqueufng, the 90x0- 
lional QELb are to be firtkad one to anoOier from 
Top-AddfiKQB. to BohAddnMB. The atope are 
Dstod bekm In an order which continuously main- 
tains a wen formed queua Noto. a "weU formed 
queue* refora to a TOGhBOQ pair and Ms aaao- 
dated queue conforming to the above definitions. 
1. loddng BOa perhapa wailing for It to be- 
come available; 

a pulltoo miO into M polntor of BoMddnKEU 
making It Now Blank; 

3. toading messages Into Okl-Blank. and all 
Addnl-QELB except New-Blank; 

< putting memory addreaa of Top-Addni into 
link pointer of Old Blank; 
5. putting address of New-Blank iRtoBOQ; and 
a untocking BOa 

Retenring now to Figures 4A-B, there are de- 
puted two eKamples using a DEQUE operafion in 
whkii a dngfe QEL Is removed fnm eie top of a 
queue. A prooessor copies into the TOO the con- 
tents of the Onk pointer from the first QEL in the 
queue. To remove a continuously inked sequence 
of QELs. a processor changes the TOO pointer, or 
a single QEL link pointer, so as to point around the 
QELs being removed. The dequeue steps are ist- 
ed bekiw In an order whteh continuously mdntdns 
aweOfomiedqueue. 

1. if TOQ e BOa eriOng without tocMng as 

queue to empty of non4Manka; 

Z kxktog TOa oondHfcintfy after wailing for R 

to become avaited)le; 

a reading BOa any QEL at that address or 
Bnkad beyond it is faieSgibto; 

4. removing one or more eSgibte QEU from 
anywhere on the queue; and 

5. untocMng TOQ. 

The QEL pointed to by BOa when BOO is 
read. Is treated as IneGgfbte. White a BOQ teck 
hokfer may make IMS a vaU QEL and may change 
BOQ, the QEL will remain IneBtfbte for this execu- 
tion of enqueue or reorder. 

Fteordering te a two step prooesa In which 
QEL(s) are first dequeued from, and then rain8e^ 
ted into, the eUg^ QEL chain. The processor 
doing the reordering hokSs the TOQ took for the 
duratton of both steps. So to move a singte QEI^ 
caltod -Moving<3EL*. to the top ofthe queue, a 
p r ocessor s dequeues the QEL. as defined pre- 
vkmsiy, and then reinseds It by changing Moving- 
QEL*s Gnk potnter to the value in TOQ. and putting 
the address of Movlng<IEL Into TOQ. 

to a dmOar manner a processor can dequeue 
any nurnber of eligibte QELs. Oik them together in 
one or more fragmentary chains, and then rsinsert 
the fragmems back into the queu . fteinsertion can 



be done maintaining a weU fdnned queue by: 
1* aetting Ink pointer of tragmentfa final QEL to 
addreaa of QEL that will foltow tragmam In 
queur.and 

6 2. aetting TOQ pointer, or Onk pointer of QEL 
that to to precede fragment to the address of 
first QEL In fragment 

For any operatfon to continuously maintain a 
wefl formed queue, each aihgte word storage up- 

ro date of a pointer In ahared memory must complete 
fuliy. If a process ttien follows the steps of an 
operaUon in the order given, the queue wf D remain 
weO formed. In the event of most hardware failures, 
or of a prematura process terminafiort some In- 

16 transit QELs may not t)e on the queue, but the 
queue itself will remain wefi formed. Other pro- 
cesses wOl be abte to oonfinue wortdng wHh such a 
queue. 

In the InHial example the aflocatlon of shared 
20 memory can t>e a processor only fonctfon. This can 
be achieved k»y having the controHers reuse each 
work queue element as the QEL in whfch to report 
oomptefion ataius. 

28 Claims 

1. A mettiod of passing task messagea in a date 
processing system indufing a pturslity of high- 
speed pw)oessor8 9. 7). an e)dBmal atorage 
so subsystem (3). and shared internal memory 
(13). aakt mettiod oomprteing the steps of: t v 

defining a first 6nked Gst in the shared 
internal memory wHh separately tocksbto fest 
as and second ends; and 

oparatfng aaid list as a queue of task mas- 
aagea passing between ttie high-speed pmoee- 
sors and the storage subsytem. tockaUy en- 
40 queidng tesk messages at the first end of ttie 
queue and independently tockably dequeuing 
task messagea from the second end of the 
queue. 

45 2. A ntethod as claimed in daim 1. in which the 
task messagea are enqueued at aaki first end 
of the queue by the high-speed processor s , 
and dequeued from the second end of the 
queue by the external storage subsystem. 

60 

a A mettiod as claimed in daim 2. fiirttier oom- 
fwtsing ttie steps of: 

defining a second Bnked list in the shared 
69 totemal memory wtth aaparately tockabte first 
and aaoond enda; and 

operattng aakI aeoond Dst as a queue of 
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task messages passing tMween the tiigth 

speed prooessofs and the storage subsysttnu 
task messages being todcaMy enqueued by 
the externa) storage subsystem at the first end 
of the queue, and independently task mes» s 
sages being kickably dequeued by the higfi 

speed prooessor s from the second end of the 
queue. 

4. A method as claimed in daim 3» further com- ro 
prising the steps of: 

defirAig re fe r en oe points end operator sets 
over saki first and second lists, ono reference 
point being assodatsd with the second end of is 
each Ost end each operator eel Including top 
of Itet (TOQ) end bottom of fist (BOO) pointers, 
and top of est (TOOL) and bottom of fist 
(BOQL) lockwords; 

so 

obttfrdng a first k>ck by one of the proces- 
sors on sakt second end of the first fist upon 
sakf one processor matching tfie BOQI^ em- 
bedding task messages between the reference 
point and the last message in five fist, and » 
releasing saM first took: 

obtaining a second tock by the subsystem 
onsakJfirstendofthefiTBtfist i^xxi sakI 
subsystem niatching the TOGU^ rsniovIng one so 
or more task messages ftom eaki first fist, and 
releasing sM second took. 

fib A method as claimed in daim 4, wherein only 
the hoMer of stid second fcxfc (TOOq may as 
after any poMer to file non-rsferenoe point end 
of the fist or any of the task messages in the 
fist, and further wher^n only the hoUer of file 
first took (BOQL) may alter any pointer des- 
ignating the rsference point end of the fist 40 

6. A method as claimed in any prececfing daim, 
wherein sald.mettiod further comprises fiie 
step of: 

46 

reorderfng the fist of task messages by 
obtaining a k)ck on the second end of the first 
list when available, removing task messages 
from anywhere on the fist HnMng at least some 
of tfie dequeued task messages togettier ki so 
one or more fragmentary chains, and ttien rein- 
serting the fragmentary chains back into the 
queue, and rsleasing th took. 

7. A mettiod as daimed In any of claims 2 to ss 
wtierein the prooessors originate task me^ 
sages in ttie fom of oontrd btocks (DCB*s) for 

the subsystem, each DCB specifying one or 



more access operatfone to be executed by 
sakI subsystem, eald 0C8*^ being enqueued 
on the first Dst tyy the orlgirBting pr ocessors, 
and sakJ subsystem dequeuing and processing 
each DC8 from sakJ first fist acoor^fing to 
eittier an external disdpfine (UFO, RLO. RFO) 
or according to a priority raordering of said 
first fist or poriton thereof. 

a A mettiod as claimed in daim 7. wherein each 
DCB assumes eittier a waifing, ecfive, or com- 
pleted etatus. the waifing DCB*8 constituting 
the first fist ecfive DCB*s bdng currantty pro- 
cessed, and completed DOB'S constituting the 
second fist 

a A mettiod as claimed in daim 7 or a wherein 
ttie suft>system processes task messages de- 
queued from said first fist updates each task 
message, and enqueuee ttie updated task 
messages onto the second fist said originating 
processors dequet^ng and processing each 
updated task message from said second fist 
aoconfing to eittier an OKtemal disdpfine PJFO. 
HLO, HFO) or to a priority raordering of said 
second Dst or porfton thereof. 

ia A data processing system inducfing a phffafity 
of Mglh-speed prooessor s Oi, 7). an e^emal 
storage nteystom (3). arid shared Memal 
memory (1^ saM system further kiducfirv 

meens for defining first and second finked 
fists to file shared menrary each witti sepa- 
rately tockable fkst and second ends; 

means for operating eaid first and second 
fists as wait and completton queues of task 
messegee respecfively. tockaUy enqueuing 
task messages at the first end of a queue and 
independentty tockabiy dequeuing task mes- 
sages from ttie second end of ttie queue; 

means responsive to task messages origl- 
nafing from processors for writing ttie task 
messages into the shared memory, finldng said 
task messages into ttie queue, and signal* 
fing file storage subsystem accordingly; 

means at the storage subsystem 
aperiodically rasponsh/e to sakJ sIgnalBng for 
dequeuing ttie task messages from ttie wait 
queue, actively processing the dequeued task 
messages, enqueuing the processed task mes- 
sages onto ttie completion queue to saki 
shared memory, and dgnafiing ttie processor s 
aoconfingly;and 
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means apertodically responsive to the sub- 
system signals for deciueuing the prooessed 
task messages from the completion queue. 
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